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Abstract — We study the problem of scheduling periodic 
real-time tasks so as to meet their individual minimum 
reward requirements. A task generates jobs that can be 
given arbitrary service times before their deadlines. A task 
then obtains rewards based on the service times received 
by its jobs. We show that this model is compatible to the 
imprecise computation models and the increasing reward 
with increasing service models. In contrast to previous work 
on these models, which mainly focus on maximize the total 
reward in the system, we aim to fulfill different reward 
requirements by different tasks, which offers better fairness 
and allows fine-grained tradeoff between tasks. We first 
derive a necessary and sufficient condition for a system, 
along with reward requirements of tasks, to be feasible. We 
also obtain an off-line feasibility optimal scheduling policy. 
We then studies a sufficient condition for a policy to be 
feasibility optimal or achieves some approximation bound. 
This condition can serve as a guideline for designing on- 
line scheduling policy and we obtains a greedy policy based 
on it. We prove that the on-line policy is feasibility optimal 
when all tasks have the same periods and also obtain an 
approximation bound for the policy under general cases. 

I. Introduction 

In classical hard real-time systems, every job needs to 
be completed before its deadline, or the system suffers 
from a timing fault. In practice, many applications allow 
approximate results and partially completed jobs only 
degrade the overall performance rather than causing a 
fault. Imprecise computation models O, JS] and increas- 
ing reward with increasing service (IRIS) models HlOU 
have been proposed to deal with such applications. Most 
work on these models only aims to minimize the total 
error, or, equivalently, maximize the total reward of the 
system without any considerations on fairness. However, 
in many applications, rewards of different tasks are not 
additive and satisfying individual reward requirements 
is more important than maximizing total rewards. For 
example, consider a server that provides video streams 
to subscribers. Deadline misses will only cause losses on 
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some frames and degrade the video quality, which is usu- 
ally tolerable as long as such losses happen infrequently. 
In such an application, a policy that aims to maximize 
total reward may end up providing perfect video quality 
for some subscribers while only offering poor quality 
for others. In contrast, a desirable policy should aim at 
providing reasonably good quality to all of its subscribers. 

In this paper, we describe a model that considers the 
hard delay bounds of tasks as well as rewards for partially 
completed jobs, in a system with a set of periodic tasks. 
The relationship between service times and rewards can 
be any arbitrary increasing and concave function and may 
differ from task to task. We allow each task to have its own 
individual requirement on the average reward it obtains. 
We show that both the imprecise computation model and 
the IRIS model are special cases of our model. 

Based on the model, we first analyze the conditions 
for feasibility, that is, whether there exists a scheduling 
policy that meets the individual reward requirements of 
all tasks in the system. We prove a necessary and sufficient 
condition for feasibility. We also propose a linear time 
algorithm for evaluating whether a system is feasible. 
Along with the feasibility condition, we also derive an off- 
line scheduling policy that is feasibility optimal, meaning 
that it fulfills all feasible systems. 

We then study the problem of designing on-line 
scheduling policies. We derive a sufficient condition for 
a policy to be feasibility optimal, or, serve as an approx- 
imation policy with some approximation bound. Using 
this condition as a guideline, we propose an on-line 
scheduling policy. We prove that this on-line policy fulfills 
every feasible system in which periods are the same for 
all tasks. We also obtain an approximation bound for this 
policy when periods of tasks may be different. 

In addition to theoretical studies, we also conduct 
simulations to verify our results. We compare our policy 
against one proposed by Aydin et al 1 1 ] , which is proved 
to be an optimal off-line policy that maximizes the total 
reward in any system. Simulation results suggest that al- 
though the policy proposed by [ 1 j achieves maximum to- 
tal reward, it can result in severe unfairness and does not 
allow fine-grained tradeoffs between the performances of 
different tasks. 



The rest of the paper is organized as follows. Section 
[n] summaries some existing work and, in particular, in- 
troduces the basic concepts in the imprecise computation 
model and the IRIS model. Section [In] formally describes 
our proposed model and discusses how it can capture 
the imprecise computation model and the IRIS model. 
Section HVl analyzes the necessary and sufficient condition 
for a system to be feasible, and proposes a linear time 
algorithm for evaluating feasibility. Section |V| studies the 
problem of scheduling jobs and obtains a sufficient con- 
dition for a policy to achieve an approximation bound 
or to be feasibility optimal. Based on this condition, 
SectionlVllproposes a simple on-line scheduling policy and 
analyzes its performance under different cases. Section lVlIl 
demonstrates our simulation results. Finally, Section IVllIl 
concludes this paper. 



II. Related Work 

The imprecise computation models ||2||, JS] have been 
proposed to handle applications in which partially com- 
pleted jobs are useful. In this model, all jobs consist 
of two parts: a mandatory part and an optional part. 
The mandatory part needs to be completed before its 
deadline, or else the system suffers from a timing fault. 
On the other hand, the optional part is used to further 
enhance performance by either reducing errors or in- 
creasing rewards. The relations between the errors, or 
rewards, and the time spent on the optional parts, are 
described through error functions or reward functions. 
Chung, Liu, and Lin O have proposed scheduling policies 
that aim to minimize the total average error in the system 
for this model. Their result is optimal only when the 
error functions are linear and tasks generate jobs with 
the same period. Shih and Liu [4] have proposed policies 
that minimize the maximum error among all tasks in the 
system when error functions are linear. Feiler and Walker 
|[5l| have used feedback to opportunistically schedule 
optional parts when the lengths of mandatory parts may 
be time-varying. Mejia-Alvarez, Melhem, and Mosse 
have studied the problem of maximizing total rewards in 
the system when job generations are dynamic. Chen et al 
(Til have proposed scheduling policies that defer optional 
parts so as to provide more timely response for mandatory 
parts. Zu and Chang [8] have studied the scheduling 
problem when optional parts are hierarchical. Aydin et 
al 111 have proposed an off-line scheduling policy that 
maximizes total rewards when the reward functions are 
increasing and concave. Most of these works only concern 
the maximization of the total reward in a system. Amir- 
ijoo, Hansson, and Son [9] have considered the tradeoff 
between data errors and transaction errors in a real-time 
database. The IRIS models can be thought of as special 
cases of the imprecise computation models where the 
lengths of mandatory parts are zero. Scheduling policies 
aimed at maximizing total rewards have been studied for 
such models [ilOil . [illil . 



III. System Model 

Consider a system with a set S = {A,B,. . .} of 
real-time tasks. Time is slotted and expressed by i G 
{0, 1, 2, ... }. Each task X generates a job periodically with 
period tx ■ A job can be executed multiple times in the 
period that it is generated; the execution of a job does not 
mean its completion. The job is removed from the system 
when the next period begins. In other words, the relative 
deadline of a job generated by task X is also tx- We 
assume that all tasks in S generate a job at time t = 0. We 
denote a frame as the time between two consecutive time 
slots where all tasks generate a job. The length of a frame, 
which we denote by T, is the least common multiple of 
{rxl-'^ e S}. Thus, a frame consists of T/tx periods of 
task X. 

As noted above, each job can be executed an arbitrary 
number of time slots before its deadline. Each task obtains 
a certain reward each time that its job is executed. The 
total amount of reward obtained by a task in a period 
depends on the number of times that its job has been 
executed in the period. More formally, task X obtains 
reward r^ > when it executes its job for the «*'' time in 
a period. For example, if a job of task X is executed a total 
of 71 time slots, then the total reward obtained by task X 

r^- We further assume 



in this period is r^ 

that the marginal reward of executing a job decreases as 



' X 



the number of executions increases, that is. 



X 



< r 



x> 



for all i and X. Thus, the total reward that a task obtains 
in a period is an increasing and concave function of the 
number of time slots that its job is executed. 

A scheduling policy -q for the system is one that chooses 
an action in each time slot. The action taken by ?/ at time 
t is described by ry(i) = {X,i), meaning that the policy 
executes the job of task X at time t and that this is the 
i*'' time that the job is being executed in the period. Fig. [T] 
shows an example with two tasks over one frame, which 
consists of two periods of task A and three periods of 
task B. In this example, action {A, 1) is executed twice 
and (A, 2) is executed once. Thus, the reward obtained 



by task A in this frame is 2r]^ 



On the other hand. 



the reward obtained by task B in this frame is 3r^. 

The performance of the system is described by the long- 
term average reward per frame of each task in the system. 

Definition 1 : Let sx (t) be the total reward obtained by 
task X between time and time t under some scheduling 
policy 77. The average reward of task X is defined as qx := 

liminft^oo ^f/T- 

We assume that there is a minimum average reward 
requirement for each task X, q^ > 0. We wish to verify 
whether a system is feasible, that is, whether each task can 
have its minimum average reward requirement satisfied. 

Definition 2: A system is fulfilled by a scheduling policy 
7] if, under 77, qx > qx with probability 1, for all X £ S. 

Definition 3: A system is feasible if there exists some 
scheduling policy that fulfills it. 

A natural metric to evaluate a scheduling policy is 
the set of systems that the policy fulfills. For ease of 
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Fig. 1: An example of the system and scheduling policy 
over a frame of six slots, which consists of two period of 
task A and three periods of task B. Arrows in the figure 
indicate the beginning of a new period. 



discussion, we only consider systems that are strictly 
feasible 

Definition 4: A system with minimum reward require- 
ments [g^fl-''^ G S] is strictly feasible if there exists some 
e > such that the same system with minimum reward 
requirements [(1 + e)q'^] is feasible. 

Definition 5: A scheduling policy is feasibility optimal if 
it fulfills all strictly feasible systems. 

Moreover, since the overhead for computing a feasibility 
optimal policy may be too high in certain scenarios, we 
also need to consider simple approximation policies. 

Definition 6: A scheduling policy is a p-approximation 
policy, p > 1, if it fulfills all systems with minimum 
reward requirements [q'^] such that the same system with 
minimum reward requirements [pQx] is strictly feasible. 

A. Extensions for Imprecise Computation Models 

In this section, we discuss how our proposed model 
can be used to handle imprecise computation models and 
IRIS models. In such models, a task consists of two parts: 
a mandatory part and an optional part. The mandatory 
part is required to be completed in each period, or else the 
system fails. After the mandatory part is completed, the 
optional part can be executed to improve performance. 
The more optional parts executed for a task, the more 
rewards it gets. 

Let mx be the length of the mandatory part of task X, 
that is, it is required that each job of X is executed at 
least mx time slots in each of its period. Let ox be the 
length of the optional part of task X. To accommodate this 
scenario, we define a symbolic value M with the following 
arithmetic reminiscent of the "Big- A/ Method" in linear 
programming: OxAf = 0, aM+bM = {a+b)M, ax{bM) = 
{ab)M, aM + c> bM + d, ii a > b, and aM + c> aM + d 
if c > d, for all real numbers a, b, c, d. Loosely speaking, 
M can be thought of as a huge positive number. For each 
task X, we set r^ = r^ = ■ ■ ■ ~ r^-^ = M, we then 
set r;j^^+\ r^^+^ . . . , r™^+°^ according to the rewards 
obtained by X for its optional part, and r^ = 0, for all 
i > nix+ox- The minimum reward requirement of task X 
is set to be —mxM-\-q*x with q^ > 0. Thus, a scheduling 



policy that fulfills such a system is guaranteed to complete 
each mandatory part with probability one. 



IV. Feasibility Analysis 

In this section, we establish a necessary and sufficient 
condition for a system to be feasible. Consider a feasible 
system that is fulfilled by a policy rj. Suppose that, on 
average, there are f^ periods of task X in a frame in 
which the action {X, i) is taken by 77. The average reward 
of task X can then be expressed as qx ~ S[=i fx''~x- 
We can immediately obtain a necessary condition for 
feasibility. 

Lemma 1: A system with a set of tasks S — {A,B, . . .} 
is feasible only if there exists {fx\X & S,l < i < tx} 
such that 



Qx 



TX 

j = l 



X' Xi 



0<fx< 



T 



Tx 



yx e S, (1) 



yx c,S,l<i<Tx, (2) 



EE/x<r. 



(3) 



xeSi=i 



Proof: Condition ([T]) holds because task X requires 
that q*x < qx- Condition Q holds because there are 
T/tx periods of task X in a frame and thus f^ is upper- 
bounded by T/tx- Finally, the total average number of 
time slots that the system executes one of the jobs in 
a frame can be expressed as X^jces S[=i fx' which is 
upper-bounded by the number of time slots in a frame, 
T. Thus, condition ([3]) follows. ■ 

Next, we show that the conditions ©-(IS]) are 
also sufficient for feasibility. To prove this, we first 
show that the polj^ope, which contains all points 
/ = (/A,/1,---,/I'*,/b,---) that satisfy conditions 
(O and ([3]), is a convex hull of several integer 
points. We then show that for all integer points n = 
{n\, n\,..., n^ , njj, . . . ) in the polj^ope, there is a sched- 
ule under which the reward obtained by task X is at least 
E[=i'^x''x- ^s then prove sufficiency using these two 
results. 

Define a matrix H = [/i^j] with '^'Ylixes'^^ + ^ rows 
and X^XGS^-^ columns as follows: 



1, if i = 1, 

1, if i = 2j, 

-1, ifi = 2jH 

0, else. 



(4) 



Define b — [&i] to be a column vector with 2 X^xgs '^x + 
1 elements so that b\ = T; the first ta elements with 
even indices are set to T/ta, that is, 62 = &4 = ■ • • = 
&2t,i = T/ta', the next tb elements with even indices are 
set to T/tb, and so on. All other elements are set to 0. 



For example, the system shown in Fig. [T] would have 
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Thus, conditions Q and ^ can be described as Hf < 
b. Theorem 5.20 and Theorem 5.24 in 11121 shows the 
following: 

Theorem 1: The polytope defined by {f\Hf < b}, 
where b is an integer vector, is a convex hull of several 
integer points if for every subset R of rows in H, there ex- 
ists a partition oi R — R1UR2 such that for every column 
j in H, we have J2^,eRl K,3~Y.^^eB.^ /i»2 j e {1,0, -IjQ 

Since all elements in b are integers, we obtain the 
following: 

Theorem 2: The polytope defined by {f\Hf < b}, 
where H and b are derived using conditions ([2]) and ^ 
as above, is a convex hull of several integer points. 

Proof: Let R — {ri,r2,...} be the indices of some 
subset of rows in H. If the first row is in R, we choose 
Ri = {r|r £ R,r is odd} and R2 ~ {r\r £ R,r is even}. 
Since for all columns j in H, hi_j — 1, h2jj = 1, 
h2j+ij = — 1, and all other elements in column j are zero, 
we have E;,eB.^ K^j " T.^^<aR^ /i»,j e {1,0, -1}. On the 
other hand, if the first row is not in R, we choose Ri = R 
and R2 = 0. Again, we have 'Et.eB., '^^l.j~T,^^Ro ^»2 j = 
J2i £R ^ii,j G {liOj— !}■ Thus, by Theorem [1] the poly- 
tope defined by {f\Hf < 6} is a convex hull of several 
integer points. ■ 

Next we show that all integer points in the polytope 
can be carried out by some scheduling policy as follows: 



Theorem 3: Let 



(n^,n^, . 



''A y 



ng,- ■ ■) be an 
integer point in the polytope {f\Hf < b}. Then, there 
exists a scheduling policy so that qx > X][=i ''^x^x- 

Proof: We prove this theorem by constructing a 
scheduling policy that achieves the aforementioned re- 
quirement. We begin by marking deadlines of actions. 
Ideally, we wish to schedule the action {X,i) n\ times 
in a frame. Without loss of generality, we assume that 
the frame starts at time and ends at time T. Since 
there is at most one {X,i) action in a period of task 
X, we can mark the deadlines of these actions as T,T — 
Tx, ■ ■ ■ ,r— (n^ — 1)tx, respectively. The scheduling policy 
will schedule the action with the earliest deadline that has 
neither been executed in its period (that is, it does not 
schedule two actions of the same type in the same period) 
nor missed its deadline, with ties broken arbitrarily. Fig. 
[2al shows how the deadlines are marked in an example 

1 Such matrix H is called a totally unimodular matrix in combinatorial 
optimization theory. 
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(a) The deadlines that are marked 
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(A1) 
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(b) The actions scheduled before renumbering 



(A 2) 



(A 2) 
(A1) 



^ I(A1) (A 2) I (A1) I 

A t • • 1 • • 1 

(B, 
(B,1) (B, 

I . ^^'^^l . ^^'^4 , ^^'^^ 1 



(c) The actions scheduled after renumbering 

Fig. 2: An example of the scheduling policy in Theorem 
[3j Deadlines of actions are marked by putting the action 
above the arrow of its deadline. 



with n\ = \,n\ = 2,ri]j = 2, and v?g = 1. Fig. I2bl shows 
the resulting schedule for this example. Note that, under 
this policy, there are time slots where the policy schedules 
an action {X,i), but it is instead the j*'' time that the 
job of X is executed in the period. Thus, we may need 
to renumber these actions as in Fig. [2c] and define n^ 
as the actual number of times that the action {X, i) is 
executed in the frame. In the example of Fig. |2l we have 
n\ ^ 2,h\ — l,ng ~ 3, and n^ = 0. Since the policy does 
not schedule two identical actions in a period, as long as 
all actions are executed before their respective deadlines, 
we have J2i=i ^x — J2i=i "x' ^'^^ ^11 ^ ^^'^ X £ S. Thus, 



<ix = E2i 



'" ^x^x 



> EZi ^x^X' since r]^ > r% > . . . , 



for all X £ S. To avoid confusion, we refer actions by its 
type before renumbering throughout the rest of the proof. 

It remains to show that none of the actions miss their 
deadlines under this policy. We prove this by contradic- 
tion. Let dx (t) be the number of actions of task X whose 
deadlines are smaller or equal to t. By the way that 
we mark deadlines of actions, we have that ^^'^^> < 



dx{2Tx) 



< 



< 



dxjT) 



2^ , _: ^ -j^ — . We also have dx{t) = dx{kTx), 
for all t £ [kTx, {k + 1)tx)- For any t, let kx — [—\, and 



we then have 



Y^ dxjt) 

l^xes t 



XeS , , t 



<E 



dx(kxrx) 



XgS kxTx 



(5) 



< 



:dx{T) 



<1, 



where the last inequaHty follows by condition ([3]). 

Suppose there is an action {X, i) that misses its deadline 
at time t under our policy. We first consider the case where 
the policy schedules an action with deadline smaller or 
equal to t in all time slots between and t, with no time 
slot left idle. In this case, we have J2xes^^^^^ > < + 1 
and thus J^xes ^^ > ^' which contradicts Eq. ([5]). 

Next we consider the case where at some time t' < t 
the policy does not schedule an action with deadline 
smaller or equal to t. That is, at time t' , the policy either 
schedules an action whose deadline is strictly larger than 
t or stays idle. Now we first claim that t and t' cannot 
belong to the same period of X, that is, the case with 
t' > t — Tx is not possible. The only reason that {X, i) 
is not in fact scheduled at t' is that there is already one 
identical action in the corresponding period containing 
t' . This other action would have a deadline at either 
t or t — krx for some fc > 1. The former case is not 
possible because two identical actions cannot have the 
same deadline. The latter is also not possible because no 
action is scheduled after its deadline and t — krx < t' if 
t and t' belong to the same period. 

As shown above, the interval [t — tx + l^t] has the 
property that all actions scheduled in this interval have 
deadlines smaller or equal to t. Now we proceed to show 
that t' < t — Tx is also not possible. We do this by 
expanding this interval while preserving this property. 
Pick any action, {X', i'), scheduled at time tx' in the 
interval and assume that the period of X' containing tx' 
is [t]^,,t'^,]. We have tj^, < t since the deadline of {X' ,i') 
is no larger than t and the deadline of this action is at 
the end of some period of X' . Now, by the design of 
the scheduling policy, for any tx' in [t\,,tx'], the action 
scheduled in tx' should have deadline smaller or equal 
to the deadline of {X' ,i'), or otherwise {X',i') should 
have been scheduled in tx'- The deadline of the action 
scheduled in tx' is thus also smaller or equal to t. Thus, 
if t\, is smaller than the beginning of the interval, we can 
expand the interval to [t\, , t] while preserving the desired 
property. We keep expanding the interval until no more 
expansions are possible. 

Let {Y,j) be the action in the resulting interval with the 
largest period, ry, and suppose that it is scheduled at time 
ty- Assume that the period of F containing ty is [ty,ty]. 
By the way we expand the interval, [iy,iy] is within the 
expanded interval and all actions scheduled in [iy,ty] 
have deadlines smaller or equal to t. For each action in 
[iy,iy], the reason that it has not been scheduled earlier 
at time t' is because there is already one identical action 
scheduled in its period that contains t'. This identical 
action, also with deadline earlier than t, must have been 
scheduled before time t'. Since the period of this action is 



smaller or equal to Ty, its identical counterpart must have 
been scheduled in [t' — Ty + l,t' — l]. However, there are at 
most Ty — I actions scheduled in [t' — Ty + l,t'—l], while 
there are Ty actions in [ty , ty], leading to a contradiction. 
Thus, this case is also not possible. 

In sum, all actions are scheduled before their deadlines 
using this policy, and the proof is completed. ■ 

Now we can derive the necessary and sufficient condi- 
tion for a system to be feasible. 

Theorem 4: A system with a set of tasks S — {A, B,. . .} 
is feasible if and only if there exists {fx\X e 5", 1 < i < 
Tx} such that ([l]) - © are satisfied. 

Proof: Lemma [T] has established that these conditions 
are necessary. It remains to show that they are also 
sufficient. Suppose there exists / = {fx\X e 5,1 < 
i < Tx} that satisfy ([T|) - ([3]), then Theorem [2] shows 
that there exists integer vectors n[l],n[2], . . . ,n[w] such 
that / = J2u=i '^un[u], where a^'s are positive numbers 
with J2u=i Q^u = 1- Let rju be the scheduling policy for 
the integer vector n[u] as in the proof of Theorem [3j 
for each u. Theorem [3] have shown that for each u, the 
average reward obtained by X under rj^, qxiVu], is at 
least X][=i '^[^]x''x- Finally, we can design a policy as 
a weighted round robin policy that switches among the 
policies T]i,ri2, ■ ■ ■ ,r]y , with policy r]u being chosen in 
a„ of the frames. The average reward obtained by X 
is hence qx = J2u(^y-'ix[Vu] > E„"«(Erii ^iNx'^x) = 
21=1 fx^x — 1*x- Thus, this policy fulfills the system and 
so the conditions are also sufficient. ■ 

Using Theorem|4l checking whether a system is feasible 
can be done by any linear programming solver. The 
computational overhead for checking feasibility can be 
further reduced by using the fact that r^^ ^ ^X' for ^^ 
i < j. Given a system and {fx} that satisfies conditions 
dl]) - dH) with fir < ^ and /y > for some j < k and 
Y e S.Let S = uim{^ - flj^}. Construct {/j^} such 



that /^ 



fi- + s, f^ 



f^ - 6, and /3, = /3, for all 



other elements. Then {fx} also satisfies conditions ([T]) - 
dS]). Based on this observation, we derive an algorithm 
for checking feasibility as shown in Algorithm [TJ This 
essentially transfers slots from less reward earning actions 
to more reward earning actions. The running time of 
this algorithm is 0(2^g^Tx). Since a specification of a 
system involves at least the J2x£S '^^ variables of {r^}, 
Algorithm [T] is essentially a linear time algorithm. 

In addition to evaluating feasibility, the proof of The- 
orem |4] also demonstrates an off-line feasibility optimal 
policy. In many scenarios, however, on-line policies are 
preferred. In the next section, we introduce a guideline 
for designing scheduling policies that turns out to suggest 
simple on-line policies. 

V. Designing Scheduling Policies 

In this section, we study the problem of designing 
scheduling policies. We establish sufficient conditions for 
a policy to be either feasibility optimal or p-approximately 
so. 



Algorithm 1 Feasibility Checker 



Require: S, {tx\X e S}, {r^|X e S,l < i < tx}, 
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{q*x\XeS} 
for X e S do 

return Infeasible 
end if 
end for 
for X e S" do 

while g^ > do 



then 



if 



then 



fx ^ T/rx 

1*x^<l*x- ^'^x 
else 

fx ^ <ix/r\ 

end if 

i <— i + 1 

end while 
end for 
if Exes E;:'/3c<r then 

return Feasible 
else 

return Infeasible 
end if 



We start by introducing a metric to evaluate the per- 
formance of a policy -q. Let qx{k) be the total reward 
obtained by task X during the frame {{k - l)T,kT]. We 

then have qx ~ liminffc^oo /^ • We also define the 
debt of task X. 

Definition 7: The debt of task X in the frame ((fc — 
l)T,kT], dx{k) is defined recursively as follows: 

dx{k) = [dx(fc - 1) + g^ - gx(fc)] + ,VA: > 0. 

Lemma 2: A system is fulfilled by a policy rj if 
linife^oo dx{k)/k = with probability 1. 

Proof: We have dx{k) > kq*^ - Y^l^^qxii) and 
dxik)/k > g^-i ELi qxii)- Thus, if linifc^oo dx{k)/k = 

0, then grx = lim inf ^^oo '^'-/^ > 9^ ^ii<^ ^he system 
is fulfilled. ■ 

We can describe the state of the system in the A;*'* frame 
by the debts of tasks, [dx{k)\X G S]. Consider a policy 
that schedules jobs solely based on the requirements and 
the state of the system. The evolution of the state of the 
system can then be described as a Markov chain. 

Lemma 3: Suppose the evolution of the state of a sys- 
tem can be described as a Markov chain under some 
policy Tj. The system is fulfilled by 77 if this Markov chain 
is irreducible and positive recurrent. 

Proof: Since the Markov chain is positive recurrent, 
the state {dx{k) = 0,VX G 5} is visited infinitely many 
times. Further, assuming that the system is in this state at 



frames ki, fc2, fcs, • ■ •, then [fc„+i — kn] is a series of i.i.d. 
random variables with finite mean. Let /„ be the indicator 
variable that there exists some /c„ between frame fc„ and 
frame fc„+i such that dx{kn)/kn > S for some X e S, for 
some arbitrary (5 > 0. Let q^^^ = max^es^x- ^^ ^n = 1, 
we have that fc„ > k^ > n and thus dx{kn) > nS, for 
some X £ S. Since dx{k) can be incremented by at most 
q^^^ in a frame and dx{kn) = 0, fc„ - fc„ > nS/q*.^^^ and 



^n+l 



kn > kn - kn > nS / q* 



Thus, 



Prob{In = 1} < Prob{kn+i - fc„ > nd/q^g^^} 
= Prob{k2 - fci > nS/q:;nax}^ 



and 



J2 Prob{In = 1} < E ^^"^^2 - fci > nS/q:,,^ 



n=l 



< E[k2 - ki] < 00, 



By Borel-Cantelli Lemma, the probability that /„ ~ 1 
for infinitely many n's is zero, and so is the proba- 
bility that dx{k)/k > 5 for infinitely many fc's. Thus, 
lim sup ^^^dx{k)/k < S with probability 1, for all 
X £ S and any arbitrary S > 0. Finally, we have 
linife^cxj dx{k)/k = with probability 1 since dx{k) > 
by definition. ■ 

Based on the above lemmas, we determine a sufficient 
condition for a policy to be a p-approximation policy. The 
proof is based on the Foster-Lyapunov Theorem: 

Theorem 5 (Foster-Lyapunov Theorem): Consider a 

Markov chain with state space V. Let D{k) be the state 
of the Markov chain at the fc*'' step. If there exists a 
non-negative function L : V ^ R, a positive number 6, 
and a finite subset Vq of V such that: 

E[L{D{k + 1)) - L{D{k))\D{k)] < -6, if D{k) ^ 2?o, 
E[L{D{k + l))\D{k)] < 00, if D{k) e Vo, 

then the Markov chain is positive recurrent. ■ 

Theorem 6: A policy r/ is a p-approximation policy, for 
some p > 1, if it schedules jobs solely based on the 
requirements and the state of a system and, for each fc, 
the following holds: 

V gx(fc)dx(fc) > ( max S^ qxdxik))/p. 

xes bx]: [qx] is feasible ^^^ 

Proof: Consider a system with minimum reward re- 
quirements [q^] such that the same system with minimum 
reward requirements [pqx] is also strictly feasible. By 
Lemma [S] it suffices to show that under the policy ij, 
the resulting Markov chain is positive recurrent. Consider 
the Lyapunov function L{k) :— J2xes'^xik)/'^- The Lya- 
punov drift function can be written as: 

ALik + 1) :=L(fc + 1) - L{k) = i ^ [4(fc + 1) - 4(fc)] 

xes 



<Y.{q*X-qx{k))dx{k) + C, 



xes 



where C is a bounded constant. Since [pqx] is 
also strictly feasible and dx{k) > 0, there ex- 
ists e > such that (1 + £)J2xesP'ix'^x{k) < 
"^^""[qx]: [qx] is ieasihleT. xes<lxdx{k), and hence (1 + 
'^)J2xes'i*xdx{k) < J2xes^x{k)dx{k). Thus, we have 

AL{k + l)<-eY,<l*xdxik)+C. (6) 

xes 

Let Vq be the set of states [dx{k)\X e S] with 
J2xes1xdxik) < (C + 6)/e, for some positive finite 
number 6. Then, Vq is a finite set (since q^ > for all 
X e S"), with AL{k + 1) < ~5 when the state of frame 
k is not in Vq. Further, since dx{k) can be increased by 
at most q*^ in each frame, L{k + 1) is finite if the state 
of frame k is in Vq. By Theorem [5] this Markov chain is 
positive recurrent and policy 77 fulfills this system. ■ 

Since a 1 -approximation policy is also a feasibility 
optimal one, a similar proof yields the following: 

Theorem 7: A policy r] fulfills a strictly feasible system 
if it maximizes J2xes Qx{k)dx{k) among all feasible [qx] 
in every frame k. It is a feasibility optimal policy if the 
above holds for all strictly feasible systems. 

VI. An On-Line Scheduling Policy 

While Section |V| has described a sufficient condition 
for designing feasibility optimal policies, the overhead 
for computing such a feasibility optimal scheduling pol- 
icy may be too high to implement. In this section, we 
introduce a simple on-line policy. We also analyze the 
performance of this policy under different scenarios. 

Theorem [7] has shown that a policy that maximizes 
J2xes 'ix{k)dx{k) among all feasible [qx] in every frame 
k is feasibility optimal. The on-line policy follows this 
guideline by greedily selecting the job with the highest 
r^dxik) in each time slot. Assume that, at some time t 
in frame k, task X has already been scheduled ix times 
in its period. The on-line policy then schedules the task 
Y so that r\T^^dY{k) is maximized among all X e S. A 
more detailed description of this policy, which we call the 
Greedy Maximizer, is shown in Algorithm [2j 

Next, we evaluate the performance of the Greedy Max- 
imizer We show that this policy is feasibility optimal if 
the periods of all tasks are the same, and that it is 2- 
approximation in general. 

Theorem 8: The Greedy Maximizer fulfills all strictly 
feasible systems with tx = t, for all X £ S. 

Proof: It suffices to prove that the Greedy Maximizer 
indeed maximizes J2xesdx ik)qx (k) in every frame. Sup- 
pose at some frame k, the debts are {dx{k)} and the 
schedule generated by the Greedy Maximizer is ijoAiit), 
t 6 (fcT, (fc + 1)T]. Let GM := Y.X(isdx{k)qx(k) when 
rjGM is applied. Consider another schedule, rjoprit), that 
achieves MaxJ2xes dxik)qx{k) =: OPT in this frame. 
We need to show that GM > OPT. 

We are going to modify rjoprit) slot by slot until it 
is the same as rycA/- Let yfopri^) ^e the schedule after 
we have made sure ViQprp{t) — ijcAiit) for all t between 
kT and i, and let OPT^ := i2xesdx{k)qx{k) when 



Algorithm 2 Greedy Maximizer 



Require: S, {tx\X g S}, {r),|X G 5, 1 < * < tx}, 




{q*x\XeS} 


1 


T <— least common multiplier of {tx\X g S} 


2 


ior X €S do 


3 


dx^O 


4 


end for 


5 


fc.^0 


6 


t^Q 


7 


loop 


8 


t^t + l 


9 


if t mod T = 1{A new frame} then 


10 


k ^ k + 1 


11 


iov X £ S do 


12 


dx ^ [dx +q*x- qx]^ 


13 


qx ^0 


14 


end for 


15 


end if 


16 


for X <eS do 


17 


if t mod Tjf = 1{A new period for X} then 


18 


ix ^0 


19 


end if 


20 


end for 


21 


Y ^— argmaxxes?'^'''^dx 


22 


iy ^ iy -f 1 


23 


CJY ^ CJY + ?'y 


24 


execute the job of Y at time t 


25 


end loop 



Vopt(^) is applied. We then have rjopT = Vopt ^tid 
riGM = VoPT ■ "^^^ process of modification is as follows: 
If r]Qprp{i + 1) — riGMii + 1), then we do not need 
to modify anj^hing and we simply set rj^Qpj. = rjQp'p. 
On the other hand, if rfopri''- + 1) 7^ VGAiii + 1), say 
VGAiii + 1) = {AJa) and rj}ypj,{i + 1) = {B,jb), then 
we modify riQprp(t) under two different cases. The first 
case is that rjQpj, is going to schedule the action {A,ja) 
some time after i + 1 in this frame. In this case ry^j, is 
obtained by switching the two actions {A,ja) and {B,jb) 
in tjqpj,. One such example is shown in Fig. [3al Since 
interchanging the order of actions does not influence the 
value of 'Exesdxik)qxik), we have OPT'+^ = OPT' 
for this case. The second case is that "^pprp does not 
schedule the action {A,ja) in the frame. Then tiq^^j. is 
obtained by setting r]^Qprp{i -I- 1) = {A,ja) and scheduling 
the same jobs as r]Qprp for all succeeding time slots. Since 
the Greedy Maximizer schedules {A,ja) in this slot, we 
have r'^dAik) > r'gdB{k). Also, for all succeeding time 
slots, if job B is scheduled, then the reward for that slot 
is going to be increased since the number of executions 
of job B has been decreased by 1; if a job C other than 
A and B is scheduled, then the reward for that slot is not 
influenced by the modification. Fig. [3b] has illustrated one 
such example. In sum, we have that OPT^^^ > OPT^. 

We have established that OPT''+^ > OPT' for all 
i e [kT,{k + 1)T]. Since OPT = OPT^^ and GM = 



,„l • • • 

'I OPT 



„i+l • • • 

7 OPT 



(BJb) (AJa) (C,jc) (DJd) I 
• • • • • 

(AJa) (BJb) (C,jc) (DJd)! 
• • • • • 



(a) First case 



(BJb) (BJb+1) (CJc) (D, b) I 
• • • • • 

(AJa) (BJb) (CJo) (D,b)| 
• • • • 1 

(b) Second case 
Fig. 3: Examples of modification in Theorem [8] 



„i • • • 

'l OPT 



,J+I • • • 

7 OPT 



A.B 



B 



A.B 



I (A. 1) ^ (A, 2) ^ (A, 3) ^(A,4) ^ (B,1) ^ (A,5) j ^ 

(a) Greedy Maximizer 

AB b A,B 

I (A, 1) (A, 2) (B, 1) I (A, 3) (A, 4) (B, 1) I thus 0P¥+^ > OPT^ - r^/d^(fc). 

• • • • • • f In sum, for all i, if the Greed\ 



same way as in the proof of Theorem [8] By Theorem [6l 
it suffices to show that GM > OPT/2. 

We obtain ?/qp7- as follows: If yycAf (* + l) = Vopri^^^)' 
then we set rf^pj, = ij^pj,. If 7?gm(« + 1) = (AJa) ^ 
{B,jb) — Vopri^)' then we consider three possible 
cases. The first case is that the job {A,ja) is not sched- 
uled by rjQprj, in this period of A. In this case, we set 
'?OPr(* + 1) — (A, 3 a) and use the same schedule as 
VoPT ^°^ ^11 succeeding time slots. An example is shown 
in Fig. [5al The same analysis in Theorem [8] shows that 
OPT'+^ > OPT\ The second case is that the job {A,ja) 
is scheduled by viQprp in this period of A and there 
is no deadline of B before the deadline of A. In this 
case, we obtain rfQpq- by switching the jobs {A,ja) and 
{B,jb) in rJQprp. An example is shown in Fig. [Sbj We 
have OPT"^ = OPT'-+'^ for this case. The last case is that 
the job {A,ja) is scheduled by viQprp in this period of A, 
and there is a deadline of B before the deadline of A. 
In this case also, we obtain rfQpj' by switching the two 
jobs and renumbering these jobs if necessary. The rewards 
obtained by all tasks other than B are not influenced by 
this modification. However, as the example shown in Fig. 
£j the job {B,jb) in rjQprp may become a job {B,j'g) in 
rj^QPj. with j'q > JB ■ Thus, the reward obtained by B may 
be decreased. However, since rewards are non-negative, 
the amount of loss for B is at most r^ . By the design 
of Greedy Maximizer, we have r'^dAik) > t'j^ dB{k) and 



(b) Feasibility optimal scheduler 

Fig. 4: An example of the resulting schedule by the Greedy 
Maximizer and a feasibility optimal scheduler, respectively 
in Example [TJ 



OPT(fc+i)T^ we have GM > OPT and thus the Greedy 
Maximizer indeed maximizes X]xgs'^-^(^)^-^(^)- 

■ 

However, when the periods of tasks are not the 
same, the Greedy Maximizer does not always maximize 
^XGs'^x{k)qx{k) and thus may not be feasibility opti- 
mal. An example is given below. 

Example 1: Consider a system with two tasks, A and 
B, with ta = Q, tb =3. Assume that r\ = r\ = r\ ^ 

2 _ 3 _ n 
B — ^ B — '^■ 



In sum, for all i, if the Greedy Maximizer schedules 
(AJa) at time slot i + 1, we have OPT'+^ > OPT' - 
r^/dA{k). Thus, GM = OPT^''+^')^ > OPT''^ - GM = 
OPT - GM and GM > OPT/2. ■ 

VII. Simulation Results 

In this section, we present our simulation results. We 
first consider a system with six tasks, each with different 
period, tx, length of mandatory part, mx, and optional 
part. Ox. Let fxit) be the total reward X obtained in a 
period if it executes t time slots of its optional part in the 
period. Thus, per our model, we have 

if i < mx, 




if mx < i < rnx 
if i > mx + Ox ■ 



Ox, 



100, r\ = r\ = 1, r)j = 10, and r| 



Suppose, at some frame k, dA{k) — dB{k) = 1. The 
Greedy Maximizer would schedule jobs as in Fig. [4al and 
yield dA{k)qA{k) + dB{k)qB{k) = 411. On the other hand, 
a feasibility optimal scheduler would schedule jobs as in 
Fig.[4bl and yield d^(fc)g^(fc) + dB(fc)te(A:) = 420. ■ 

Although the Greedy Maximizer is not feasibility opti- 
mal, we can still derive an approximation bound for this 
policy. 

Theorem 9: The Greedy Maximizer is a 2- 
approximation policy. 

Proof: The proof is similar to that of Theorem [8j 
Define 7]gm,vopt,Vopt^GM,0PT, and OPT' in the 



As in [T] , we consider three different types of function 
fx'- exponential, logarithmic, and linear. The reward re- 
quirement of X is —m,xM -\- q*^. We compare the set of 
requirements of tasks that can be fulfilled by the Greedy 
Maximizer against the set of all feasible requirements. 
We also compare the optimal policy (OPT) introduced in 
|ljl, which aims to maximize the total per period reward, 
J2x<es1x/^- To better illustrate the results, we assume 
that all qx's are linear functions of two variables, a and 
13. We then find all pairs of {a, j5) so that the resulting 
requirements are fulfilled by the evaluated policies and 
plot the boundaries of all such pairs. We call all pairs of 
(a, p) that are fulfilled by a policy as the achievable region 



'/ OPT 



n' • • • 

'/ OPT 



,J+1 • • • 

7 OPT 



(BJb) (B,JB+1) (C,Jc)i(A, 1) . . . 

• • • • • 

(A.U) (BJb) (C.Jc)i(A,1) • • • 

• • • I • 



(a) First case 



y,i+I • • • 

7 OPT 



(BJb) (BJb+1)(C,Jc) (AJa)!' 

• • • • • 

(A.k) (BJb) (C.jc) (BJb+1)I ' 

• • • • • 

(b) Second case 

B A 

^ (B,Jb)|(B,1) ^(B,2) ^(A,u)| ' 

B ▼ A 

(A,U) I (B,1) (B,2) (B,3) | ' 



(c) Third case 
Fig. 5: Examples of modification in Theorem [9] 



of the pohcy. We also call the set of all feasible pairs of 
(a, /3) as the feasible region. The complete simulation pa- 
rameters are shown in Table [H in which most parameters 
are derived from the simulation set up of [1]. 

In each simulation of the Greedy Maximizer, we initiate 
the debt of X to be M + 1 and run the simulation for 20 
frames to ensure that it has converged. We then continue 
to run the simulation for 500 additional frames. The 
system is considered fulfilled by the Greedy Maximizer 
if none of the mandatory parts miss their deadlines in the 
500 frames, and the total reward obtained by each task 
exceeds its requirements. 

The simulation results are shown in Fig. [6l For 
both cases of exponential and logarithmic functions, the 
achievable regions of the OPT policy are rectangles. That 
is because the OPT policy only aims at maximizing the to- 
tal per-period rewards and does not allow any tradeoff be- 
tween rewards of different tasks. The achievable regions 
of the OPT policy are also much smaller than the feasible 
regions. On the other hand, the achievable regions of the 
Greedy Maximizer are very close to the feasible region for 
both the cases of exponential and logarithmic functions. 
Also, its achievable regions are strictly larger than that of 
the OPT policy. This also shows that the Greedy Maximizer 
can provide fine-grained tradeoff between tasks. 

The most surprising result is that for linear functions. 
In this case, the OPT policy fails to fulfill any pairs of 
(a,/3) except (0,0). A closer examination on the simula- 
tion result shows that, besides mandatory parts, the OPT 



Task id 


fW) 


fxit) 


f'iit) 


g*x 


A 


15(l-e-*/i5) 


71n(3t + l) 


bt 


5a 


B 


20(1 - e-3«/8) 


101n(10i + l) 


It 


7a 


C 


4(l_e-t/5) 


21n(3t + l) 


t 


a 


D 


10(1 - e-*/30) 


51n(15t-(-l) 


it 


4/3 


E 


5(l-e-«/5) 


31n(20t + l) 


2t 


2/3 


F 


8(1 _ e-*/20) 


41n(6t + l) 


3t 


3/3 



TABLE II: Task parameters for a system in which all tasks 
have the same period. 



policy only schedules optional parts of tasks D and F. This 
example shows that, in addition to restricted achievable 
regions, the OPT policy can also be extremely unfair. Thus, 
the OPT policy is not desirable when fairness is concerned. 
On the other hand, the achievable region of the Greedy 
Maximizer is almost the same as the feasible region. 
These simulation results also suggest that although we 
have only proved that the Greedy Maximizer is a 2- 
approximation policy, this approximation bound is indeed 
very pessimistic. In most cases, the performance of the 
Greedy Maximizer is not too far from that of a feasibility 
optimal policy. 

Next, we simulate a system in which all tasks have the 
same period. We assume that tx — 120, vtix = 0, and 
Ox = 120 for all X e S*. We also simulate all the three 
functions, exponential, logarithmic, and linear. Detailed 
parameters are shown in Table [III 

The simulation results are shown in Fig. [71 As in the 
previous simulations, the achievable regions of the Greedy 
Maximizer are always larger than those of the OPT policy, 
for all functions. Further, the achievable regions of the 
Greedy Maximizer are exactly the same as the feasible 
regions. This demonstrates that the Greedy Maximizer 
fulfills every strictly feasible system when the periods of 
all tasks are the same. 

VIII. Concluding Remarks 

We have studied a model in which a system consists of 
several periodic real-time tasks that have their individual 
reward requirements. This model is compatible with both 
the imprecise computation models and IRIS models. By 
making each task specify its own reward requirement, 
our model can offer better fairness, and it allows trade- 
off between tasks. Under this model, we have proved 
a necessary and sufficient condition for feasibility, and 
designed a linear time algorithm for verifying feasibility. 
We have also studied the problem of designing on-line 
scheduling policies and obtained a sufficient condition 
for a policy to be feasibility optimal, or to achieve an 
approximation bound. We have then proposed a simple 
on-line scheduling policy. We have analyzed the perfor- 
mance of the on-line scheduling policy and proved that 
it fulfills all feasible systems in which the periods of all 
tasks are the same. For general systems where periods 
may be different for different tasks, we have proved that 
the on-line policy is a 2-approximation policy. We have 
also conducted simulations and compared our on-line 



10 



Task id 


rx 


mx 


ox 


fxit) 


/^^W 


nit) 


rx 


A 


20 


1 


10 


15(l-e-*/2) 


71n(20t + l) 


5t 


5a 


B 


30 


1 


15 


20(l-e-3*/2) 


101n{50t + l) 


n 


7a 


C 


40 


2 


20 


4(l_e-t/2) 


21n(10t + l) 


t 


a 


D 


60 


3 


30 


10(l-e-*/iO) 


51n(25i + l) 


At 


4/3 


E 


80 


4 


40 


5(l-e-*/2) 


31n(30t + l) 


2t 


2/3 


F 


120 


6 


60 


8(1 - e-'/2") 


41n(6t + l) 


3t 


3/3 



TABLE I: Task parameters for a system in which tasks have different periods, fj^, f^, and /|- correspond to the 
functions for exponential, logarithmic, and linear functions, respectively. 
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(a) Exponential functions (b) Logarithmic functions (c) Linear functions 

Fig. 6: Achievable regions of scheduling policies for the system in Table [H 
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Fig. 7: Achievable regions of scheduling policies for the system in Table UIl 



policy against a policy that maximizes the total reward 
in the system. Simulation results show that the on-line 
policy has much larger achievable regions than that of 
the compared policy. 
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Abstract — We study the problem of scheduling periodic 
real-time tasks so as to meet their individual minimum 
reward requirements. A task generates jobs that can be 
given arbitrary service times before their deadlines. A task 
then obtains rewards based on the service times received 
by its jobs. We show that this model is compatible to the 
imprecise computation models and the increasing reward 
with increasing service models. In contrast to previous work 
on these models, which mainly focus on maximize the total 
reward in the system, we aim to fulfill different reward 
requirements by different tasks, which offers better fairness 
and allows fine-grained tradeoff between tasks. We first 
derive a necessary and sufficient condition for a system, 
along with reward requirements of tasks, to be feasible. We 
also obtain an off-line feasibility optimal scheduling policy. 
We then studies a sufficient condition for a policy to be 
feasibility optimal or achieves some approximation bound. 
This condition can serve as a guideline for designing on- 
line scheduling policy and we obtains a greedy policy based 
on it. We prove that the on-line policy is feasibility optimal 
when all tasks have the same periods and also obtain an 
approximation bound for the policy under general cases. 

I. Introduction 

In classical hard real-time systems, every job needs to 
be completed before its deadline, or the system suffers 
from a timing fault. In practice, many applications allow 
approximate results and partially completed jobs only 
degrade the overall performance rather than causing a 
fault. Imprecise computation models [?] , [?] and increas- 
ing reward with increasing service (IRIS) models [?] 
have been proposed to deal with such applications. Most 
work on these models only aims to minimize the total 
error, or, equivalently, maximize the total reward of the 
system without any considerations on fairness. However, 
in many applications, rewards of different tasks are not 
additive and satisfying individual reward requirements 
is more important than maximizing total rewards. For 
example, consider a server that provides video streams 
to subscribers. Deadline misses will only cause losses on 

This material is based upon work partially supported by USARO un- 
der Contract Nos. W911NF-08-1-0238 and W-911-NF-0710287, AFOSR 
under Contract FA9550-09-0121, and NSF under Contract No. CNS-07- 
21992. Any opinions, findings, and conclusions or recommendations 
expressed in this publication are those of the authors and do not 
necessarily reflect the views of the above agencies. 



some frames and degrade the video quality, which is usu- 
ally tolerable as long as such losses happen infrequently. 
In such an application, a policy that aims to maximize 
total reward may end up providing perfect video quality 
for some subscribers while only offering poor quality 
for others. In contrast, a desirable policy should aim at 
providing reasonably good quality to all of its subscribers. 

In this paper, we describe a model that considers the 
hard delay bounds of tasks as well as rewards for partially 
completed jobs, in a system with a set of periodic tasks. 
The relationship between service times and rewards can 
be any arbitrary increasing and concave function and may 
differ from task to task. We allow each task to have its own 
individual requirement on the average reward it obtains. 
We show that both the imprecise computation model and 
the IRIS model are special cases of our model. 

Based on the model, we first analyze the conditions 
for feasibility, that is, whether there exists a scheduling 
policy that meets the individual reward requirements of 
all tasks in the system. We prove a necessary and sufficient 
condition for feasibility. We also propose a linear time 
algorithm for evaluating whether a system is feasible. 
Along with the feasibility condition, we also derive an off- 
line scheduling policy that is feasibility optimal, meaning 
that it fulfills all feasible systems. 

We then study the problem of designing on-line 
scheduling policies. We derive a sufficient condition for 
a policy to be feasibility optimal, or, serve as an approx- 
imation policy with some approximation bound. Using 
this condition as a guideline, we propose an on-line 
scheduling policy. We prove that this on-line policy fulfills 
every feasible system in which periods are the same for 
all tasks. We also obtain an approximation bound for this 
policy when periods of tasks may be different. 

In addition to theoretical studies, we also conduct 
simulations to verify our results. We compare our policy 
against one proposed by Aydin et al [?] , which is proved 
to be an optimal off-line policy that maximizes the total 
reward in any system. Simulation results suggest that al- 
though the policy proposed by [?] achieves maximum to- 
tal reward, it can result in severe unfairness and does not 
allow fine-grained tradeoffs between the performances of 
different tasks. 



The rest of the paper is organized as follows. Section 
[n] summaries some existing work and, in particular, in- 
troduces the basic concepts in the imprecise computation 
model and the IRIS model. Section [In] formally describes 
our proposed model and discusses how it can capture 
the imprecise computation model and the IRIS model. 
Section HVl analyzes the necessary and sufficient condition 
for a system to be feasible, and proposes a linear time 
algorithm for evaluating feasibility. Section |V| studies the 
problem of scheduling jobs and obtains a sufficient con- 
dition for a policy to achieve an approximation bound 
or to be feasibility optimal. Based on this condition, 
SectionlVllproposes a simple on-line scheduling policy and 
analyzes its performance under different cases. Section lVlIl 
demonstrates our simulation results. Finally, Section IVllIl 
concludes this paper. 



II. Related Work 

The imprecise computation models [?], [?] have been 
proposed to handle applications in which partially com- 
pleted jobs are useful. In this model, all jobs consist 
of two parts: a mandatory part and an optional part. 
The mandatory part needs to be completed before its 
deadline, or else the system suffers from a timing fault. 
On the other hand, the optional part is used to further 
enhance performance by either reducing errors or in- 
creasing rewards. The relations between the errors, or 
rewards, and the time spent on the optional parts, are 
described through error functions or reward functions. 
Chung, Liu, and Lin [?] have proposed scheduling policies 
that aim to minimize the total average error in the system 
for this model. Their result is optimal only when the 
error functions are linear and tasks generate jobs with 
the same period. Shih and Liu [?] have proposed policies 
that minimize the maximum error among all tasks in the 
system when error functions are linear. Feiler and Walker 
[?] have used feedback to opportunistically schedule op- 
tional parts when the lengths of mandatory parts may 
be time-varying. Mejia-Alvarez, Melhem, and Mosse [?] 
have studied the problem of maximizing total rewards in 
the system when job generations are dynamic. Chen et al 
[?] have proposed scheduling policies that defer optional 
parts so as to provide more timely response for mandatory 
parts. Zu and Chang [?] have studied the scheduling 
problem when optional parts are hierarchical. Aydin et 
al [?] have proposed an off-line scheduling policy that 
maximizes total rewards when the reward functions are 
increasing and concave. Most of these works only concern 
the maximization of the total reward in a system. Amir- 
ijoo, Hansson, and Son [?] have considered the tradeoff 
between data errors and transaction errors in a real-time 
database. The IRIS models can be thought of as special 
cases of the imprecise computation models where the 
lengths of mandatory parts are zero. Scheduling policies 
aimed at maximizing total rewards have been studied for 
such models [?], [?]. 



III. System Model 

Consider a system with a set S = {A,B,. . .} of 
real-time tasks. Time is slotted and expressed by i G 
{0, 1, 2, ... }. Each task X generates a job periodically with 
period tx ■ A job can be executed multiple times in the 
period that it is generated; the execution of a job does not 
mean its completion. The job is removed from the system 
when the next period begins. In other words, the relative 
deadline of a job generated by task X is also tx- We 
assume that all tasks in S generate a job at time t = 0. We 
denote a frame as the time between two consecutive time 
slots where all tasks generate a job. The length of a frame, 
which we denote by T, is the least common multiple of 
{rxl-'^ e S}. Thus, a frame consists of T/tx periods of 
task X. 

As noted above, each job can be executed an arbitrary 
number of time slots before its deadline. Each task obtains 
a certain reward each time that its job is executed. The 
total amount of reward obtained by a task in a period 
depends on the number of times that its job has been 
executed in the period. More formally, task X obtains 
reward r^ > when it executes its job for the i*'' time in 
a period. For example, if a job of task X is executed a total 
of n time slots, then the total reward obtained by task X 

r^- We further assume 



in this period is r\ 



X 



' X 



that the marginal reward of executing a job decreases as 
the number of executions increases, that is. 



"^ 



> r 



X' 

for all i and X. Thus, the total reward that a task obtains 
in a period is an increasing and concave function of the 
number of time slots that its job is executed. 

A scheduling policy ij for the system is one that chooses 
an action in each time slot. The action taken by rj at time 
t is described by ry(i) = {X,i), meaning that the policy 
executes the job of task X at time t and that this is the 
i*'' time that the job is being executed in the period. Fig.[T] 
shows an example with two tasks over one frame, which 
consists of two periods of task A and three periods of 
task B. In this example, action {A, 1) is executed twice 
and (A, 2) is executed once. Thus, the reward obtained 



by task A in this frame is 2r\ 



On the other hand. 



the reward obtained by task B in this frame is 3r^. 

The performance of the system is described by the long- 
term average reward per frame of each task in the system. 

Definition 1 : Let sx (t) be the total reward obtained by 
task X between time and time t under some scheduling 
policy rj. The average reward of task X is defined as qx := 

liminft^oo ^fjT- 

We assume that there is a minimum average reward 
requirement for each task X, q^ > 0. We wish to verify 
whether a system is feasible, that is, whether each task can 
have its minimum average reward requirement satisfied. 

Definition 2: A system is fulfilled by a scheduling policy 
7] if, under 77, qx > qx with probability 1, for all X £ S. 

Definition 3: A system is feasible if there exists some 
scheduling policy that fulfills it. 

A natural metric to evaluate a scheduling policy is 
the set of systems that the policy fulfills. For ease of 
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T=6 

Fig. 1: An example of the system and scheduling policy 
over a frame of six slots, which consists of two period of 
task A and three periods of task B. Arrows in the figure 
indicate the beginning of a new period. 



discussion, we only consider systems that are strictly 
feasible 

Definition 4: A system with minimum reward require- 
ments [(7x1-'^ £ ^] is strictly feasible if there exists some 
e > such that the same system with minimum reward 
requirements [(1 + e)(7^] is feasible. 

Definition 5: A scheduling policy is feasibility optimal if 
it fulfills all strictly feasible systems. 

Moreover, since the overhead for computing a feasibility 
optimal policy may be too high in certain scenarios, we 
also need to consider simple approximation policies. 

Definition 6: A scheduling policy is a p-approximation 
policy, p > 1, if it fulfills all systems with minimum 
reward requirements [q'^] such that the same system with 
minimum reward requirements [pqx] is strictly feasible. 

A. Extensions for Imprecise Computation Models 

In this section, we discuss how our proposed model 
can be used to handle imprecise computation models and 
IRIS models. In such models, a task consists of two parts: 
a mandatory part and an optional part. The mandatory 
part is required to be completed in each period, or else the 
system fails. After the mandatory part is completed, the 
optional part can be executed to improve performance. 
The more optional parts executed for a task, the more 
rewards it gets. 

Let mx be the length of the mandatory part of task X, 
that is, it is required that each job of X is executed at 
least mx time slots in each of its period. Let ox be the 
length of the optional part of task X. To accommodate this 
scenario, we define a symbolic value M with the following 
arithmetic reminiscent of the "Big- A/ Method" in linear 
programming: OxAf = 0, aM+bM = {a+b)M, ax{bM) = 
{ab)M, aM + c> bM + d, ii a > b, and aM + c> aM + d 
if c > d, for all real numbers a, b, c, d. Loosely speaking, 
M can be thought of as a huge positive number For each 



X 



'X ~ 
mx+ox 
' X 



_ „mx _ 
X 



M, we then 
according to the rewards 



task X, we set 

rpt r™x-l-l mx+2' 
acL / j^ , I X 1 

obtained by X for its optional part, and rx = 0, for all 
i > mx + Ox ■ The minimum reward requirement of task 
X is set to be mxM + ijx with (jx > 0. Thus, a scheduling 



policy that fulfills such a system is guaranteed to complete 
each mandatory part with probability one. 



IV. Feasibility Analysis 

In this section, we establish a necessary and sufficient 
condition for a system to be feasible. Consider a feasible 
system that is fulfilled by a policy rj. Suppose that, on 
average, there are fx periods of task X in a frame in 
which the action {X, i) is taken by 77. The average reward 
of task X can then be expressed as qx = Yl'i=i fx''~x- 
We can immediately obtain a necessary condition for 
feasibility. 

Lemma 1: A system with a set of tasks S — {A,B, . . .} 
is feasible only if there exists {fx\X & S,l < i < tx} 
such that 



Qx 



TX 



X' Xi 



0<fx< 



T 



TX 



yx e S, (1) 



yx c,S,l<i<Tx, (2) 



EE/x<r. 



(3) 



xeSi=i 



Proof: Condition ([T]) holds because task X requires 
that q*x < qx- Condition Q holds because there are 
T/tx periods of task X in a frame and thus fx is upper- 
bounded by T/tx- Finally, the total average number of 
time slots that the system executes one of the jobs in 
a frame can be expressed as X^jces S[=i fx' which is 
upper-bounded by the number of time slots in a frame, 
T. Thus, condition ([3]) follows. ■ 

Next, we show that the conditions ©-(IS]) are 
also sufficient for feasibility. To prove this, we first 
show that the polj^ope, which contains all points 
/ = (/A,/1,---,/I'*,/b,---) that satisfy conditions 
(O and ([3]), is a convex hull of several integer 
points. We then show that for all integer points n = 
{n\, n\,..., n^ , njj, . . . ) in the polj^ope, there is a sched- 
ule under which the reward obtained by task X is at least 
E[=i'^x''x- Ws then prove sufficiency using these two 
results. 

Define a matrix Af — [mij] with '2J2xes'''^ + ^ rows 
and J2xes'''x columns as follows: 



1, ifi = l, 

1, iii = 2j, 

-1, ifi = 2jH 

0, else. 



(4) 



Define b — [&i] to be a column vector with 2 X^xgs '^x + 
1 elements so that b\ = T; the first ta elements with 
even indices are set to T/ta, that is, 62 = &4 = ■ • • = 
&2t,i = T/ta', the next tb elements with even indices are 
set to T/tb, and so on. All other elements are set to 0. 



For example, the system shown in Fig. [T] would have 

T 

T/ta 


T/ta 




M 



1, 


1, 


1, 


1, 




1, 


0, 


0, 


0, 




-1, 


0, 


0, 


0, 




0, 


1, 


0, 


0, 




0, 


-1, 


0, 


0, 




0, 


0, 


1, 


0, 




0, 


0, 


-1, 


0, 





a partition oi R — RiU R2 such that for every column 
in M, we have E^,eB.^ "^^^ -E^,efl2 "^»2j & {1 



T/tb 




Thus, conditions (O and dsj can be described as Mf < b. 
Theorem 5.20 and Theorem 5.24 in [?] shows the follow- 
ing: 

Theorem 1: The polj^ope defined by {f\Mf < b}, 
where b is an integer vector, is a convex hull of several in- 
teger points if for every subset R of rows in M, there exists 

r column j 

Since all elements in b are integers, we obtain the 
following: 

Theorem 2: The polj^ope defined by {f\Mf < b}, 
where M and 6 are derived using conditions (O and ^ 
as above, is a convex hull of several integer points. 

Proof: Let R — {ri,r2,...} be the indices of some 
subset of rows in M. If the first row is in R, we choose 
Ri = {r|r G R,r is odd} and R2 = {r\r £ R,r is even}. 
Since for all columns j in M, rni.j = 1, m2j.j = 1, 
™2j+i.j = —1, and all other elements in column j are 
zero, we have E^,eRl '"^u " T,^^eR2 '"^^j e {1,0, -1}. 
On the other hand, if the first row is not in R, we choose 
Ri — R and R2 = 0. Again, we have J2i ^b. ™hj' ~ 
J2^2eR2^^2,3 = E»iefl,i^"»ij e {1,0, -ij-. Thus, by 
Theorem [T] the polytope defined by {f\Mf < 6} is a 
convex hull of several integer points. ■ 

Next we show that all integer points in the polytope 
can be carried out by some scheduling policy as follows: 

Theorem 3: Let n — (nj^,n^, . . . ,n^'*,n]3, . . . ) be an 



integer point in the polytope {f\Mf < b}. Then, there 
exists a scheduling policy so that qx > J2l=i ''^x^x- 

Proof: We prove this theorem by constructing a 
scheduling policy that achieves the aforementioned re- 
quirement. We begin by marking deadlines of actions. 
Ideally, we wish to schedule the action {X,i) n\ times 
in a frame. Without loss of generality, we assume that 
the frame starts at time and ends at time T. Since 
there is at most one {X,i) action in a period of task 
X, we can mark the deadlines of these actions as T,T — 
Tx, ■ ■ ■ ,r— (n^ — 1)tx, respectively. The scheduling policy 
will schedule the action with the earliest deadline that has 
neither been executed in its period (that is, it does not 
schedule two actions of the same type in the same period) 
nor missed its deadline, with ties broken arbitrarily. Fig. 
[2al shows how the deadlines are marked in an example 

1 Such matrix M is called a totally unimodular matrix in combinatorial 
optimization theory. 
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(b) The actions scheduled before renumbering 
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(c) The actions scheduled after renumbering 

Fig. 2: An example of the scheduling policy in Theorem 
[3j Deadlines of actions are marked by putting the action 
above the arrow of its deadline. 



with n\ = \,n\ = 2,ri]j = 2, and v?g = 1. Fig. I2bl shows 
the resulting schedule for this example. Note that, under 
this policy, there are time slots where the policy schedules 
an action {X,i), but it is instead the j*'' time that the 
job of X is executed in the period. Thus, we may need 
to renumber these actions as in Fig. [2c] and define n^ 
as the actual number of times that the action {X, i) is 
executed in the frame. In the example of Fig. |2l we have 
n\ ^ 2,h\ — l,ng ~ 3, and n^ = 0. Since the policy does 
not schedule two identical actions in a period, as long as 
all actions are executed before their respective deadlines, 
we have J2i=i ^x — J2i=i "x' ^'^^ ^11 ^ ^^'^ X € S. Thus, 



<ix = E2i 



'" ^x^x 



> EZi ^x^X' since r]^ > r% > . . . , 



for all X e S. To avoid confusion, we refer actions by its 
type before renumbering throughout the rest of the proof 

It remains to show that none of the actions miss their 
deadlines under this policy. We prove this by contradic- 
tion. Let dx (t) be the number of actions of task X whose 
deadlines are smaller or equal to t. By the way that 
we mark deadlines of actions, we have that ^^'^^> < 



dx{2Tx) 



< 



< 



dxjT) 



2^ , _: ^ -j^ — . We also have dx{t) = dx{kTx), 
for all t e [krx, {k + l)rx)- For any t, let kx — [—\, and 



we then have 



Y^ dxjt) 

l^xes t 



XeS , , t 



<E 



dx(kxrx) 



XgS kxTx 



(5) 



< 



:dx{T) 



<1, 



where the last inequaHty follows by condition ([3]). 

Suppose there is an action {X, i) that misses its deadline 
at time t under our policy. We first consider the case where 
the policy schedules an action with deadline smaller or 
equal to t in all time slots between and t, with no time 
slot left idleS. In this case, we have X^xgs '^xit) > t + 1 
and thus J^xes ^^ > ^' which contradicts Eq. ©. 

Next we consider the case where at some time t' < t 
the policy does not schedule an action with deadline 
smaller or equal to t. That is, at time t' , the policy either 
schedules an action whose deadline is strictly larger than 
t or stays idle. Now we first claim that t and t' cannot 
belong to the same period of X, that is, the case with 
t' > t — Tx is not possible. The only reason that {X, i) 
is not in fact scheduled at t' is that there is already one 
identical action in the corresponding period containing 
t' . This other action would have a deadline at either 
t or t — krx for some fc > 1. The former case is not 
possible because two identical actions cannot have the 
same deadline. The latter is also not possible because no 
action is scheduled after its deadline and t — krx < t' if 
t and t' belong to the same period. 

As shown above, the interval [t — tx + l^t] has the 
property that all actions scheduled in this interval have 
deadlines smaller or equal to t. Now we proceed to show 
that t' < t — Tx is also not possible. We do this by 
expanding this interval while preserving this property. 
Pick any action, {X', i'), scheduled at time tx' in the 
interval and assume that the period of X' containing tx' 
is [t]^,,t'^,]. We have tj^, < t since the deadline of {X' ,i') 
is before t and the deadline of this action is at the end of 
some period of X' . Now, by the design of the scheduling 
policy, for any ix' in [t\r,,tx'], the action scheduled in tx' 
should have deadline smaller or equal to the deadline of 
{X' ,i'), or otherwise {X' ,i') should have been scheduled 
in tx'- The deadline of the action scheduled in tx' is 
thus also smaller or equal to t. Thus, if t\, is smaller 
than the beginning of the interval, we can expand the 
interval to [t^,,i] while preserving the desired property. 
We keep expanding the interval until no more expansions 
are possible. 

Let (F, j) be the action in the resulting interval with the 
largest period, ry, and suppose that it is scheduled at time 
ty. Assume that the period of F containing ty is [tyjty]. 
By the way we expand the interval, [iy,iy] is within the 
expanded interval and all actions scheduled in [iy,ty] 
have deadlines smaller or equal to t. For each action in 
[iy,iy], the reason that it has not been scheduled earlier 
at time t' is because there is already one identical action 
scheduled in its period that contains t' . This identical 
action, also with deadline earlier than t, must have been 
scheduled before time t' . Since the period of this action is 



smaller or equal to Ty, its identical counterpart must have 
been scheduled in [t' — Ty + l.t' — 1]. However, there are at 
most Ty — I actions scheduled in [t' — Ty + l,t'—l], while 
there are Ty actions in [ty , ty], leading to a contradiction. 
Thus, this case is also not possible. 

In sum, all actions are scheduled before their deadlines 
using this policy, and the proof is completed. ■ 

Now we can derive the necessary and sufficient condi- 
tion for a system to be feasible. 

Theorem 4: A system with a set of tasks S — {A, B,. . .} 
is feasible if and only if there exists {fx\X e 5", 1 < i < 
Tx} such that ([l]) - © are satisfied. 

Proof: Lemma [T] has established that these conditions 
are necessary. It remains to show that they are also 
sufficient. Suppose there exists / = {fx\X e 5,1 < 
i < Tx} that satisfy ([T|) - ([3]), then Theorem [2] shows 
that there exists integer vectors n[l],n[2], . . . ,n[w] such 
that / = J2u=i '^un[u], where a^'s are positive numbers 
with J2u=i Q^u = 1- Let rju be the scheduling policy for 
the integer vector n[u] as in the proof of Theorem [3j 
for each u. Theorem [3] have shown that for each u, the 
average reward obtained by X under rj^, qxiVu], is at 
least X][=i '^[^]x''x- Finally, we can design a policy as 
a weighted round robin policy that switches among the 
policies T]i,ri2, ■ ■ ■ ,r]y , with policy r]u being chosen in 
a„ of the frames. The average reward obtained by X 
is hence qx = J2u(^y-'ix[Vu] > E„"«(Erii ^iNx'^x) = 
21=1 fx^x — 1*x- Thus, this policy fulfills the system and 
so the conditions are also sufficient. ■ 

Using Theorem|4l checking whether a system is feasible 
can be done by any linear programming solver. The 
computational overhead for checking feasibility can be 
further reduced by using the fact that r^^ ^ ^X' for ^^ 
i < j. Given a system and {fx} that satisfies conditions 
dl]) - dH) with fx<T^ and /^ > for some j <k and 
X G 5. Let (5 = minj;;^ - /^, f^}. Construct {P^} such 

that fx^ fx+ 5> fl= fx - S, and fx = fx ^r all 
other elements. Then {fx} also satisfies conditions ([l]) - 
dS]). Based on this observation, we derive an algorithm 
for checking feasibility as shown in Algorithm [TJ This 
essentially transfers slots from less reward earning actions 
to more reward earning actions. The running time of 
this algorithm is 0(2^g^Tx). Since a specification of a 
system involves at least the J2x£S '^^ variables of {r^}, 
Algorithm [T] is essentially a linear time algorithm. 

In addition to evaluating feasibility, the proof of The- 
orem |4] also demonstrates an off-line feasibility optimal 
policy. In many scenarios, however, on-line policies are 
preferred. In the next section, we introduce a guideline 
for designing scheduling policies that turns out to suggest 
simple on-line policies. 

V. Designing Scheduling Policies 

In this section, we study the problem of designing 
scheduling policies. We establish sufficient conditions 
for a policy to be either feasibility optimal or a p- 
approximately so. 



Algorithm 1 Feasibility Checker 



Require: S, {tx\X e S}, {r^|X e S,l < i < tx}, 
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{q*x\XeS} 
for X e S do 

return Infeasible 
end if 
end for 
for X e S" do 

while g^ > do 



then 



if 



then 



fx ^ T/rx 

1*x^<l*x- ^'^x 
else 

fx ^ <ix/r\ 

end if 

i <— i + 1 

end while 
end for 
if Exes E;:'/3c<r then 

return Feasible 
else 

return Infeasible 
end if 



We start by introducing a metric to evaluate the per- 
formance of a policy -q. Let qx{k) be the total reward 
obtained by task X during the frame {{k - l)T,kT]. We 

then have qx ~ liminffc^oo /^ • We also define the 
reward debt of task X. 

Definition 7: The reward debt of task X in the frame 
{{k — 1)T, kT], dx{k) is defined recursively as follows: 

dx{k) = [dx{k -l)+q*x- qx{k)] + ,yk > 0. 

Lemma 2: A system is fulfilled by a policy rj if 
linife^oo dx{k)/k = with probability 1. 

Proof: We have dx{k) > kq*^ - J^^^^qxii) and 
dxik)/k > g^-i ELi qxii)- Thus, if linifc^oo dx{k)/k = 

0, then grx = lim inf ^^oo '^'-/^ > 9^ ^ii<^ ^he system 
is fulfilled. ■ 

We can describe the state of the system in the k^^ 
frame by the reward debts of tasks, [dx{k)\X G S]. 
Consider a policy that schedules jobs solely based on the 
requirements and the state of the system. The evolution of 
the state of the system can then be described as a Markov 
chain. 

Lemma 3: Suppose the evolution of the state of a sys- 
tem can be described as a Markov chain under some 
policy 77. The system is fulfilled by 77 if this Markov chain 
is irreducible and positive recurrent. 

Proof: Since the Markov chain is positive recurrent, 
the state {dx{k) = 0,VX e 5} is visited infinitely many 



times. Further, assuming that the system is in this state at 
frames ki, fc2, k^, . . . , then [kn+i — A:„] is a series of i.i.d. 
random variables with finite mean. Let /„ be the indicator 
variable that there exists some /c„ between frame fc„ and 
frame fc„+i such that dx{kn)/kn > 5 for some X € S, for 
some arbitrary 5 > 0. Let q^^ix = maxxesg^- ^^ In — 1, 
we have that kn > kn > n and thus dx{kn) > nS, for 
some X & S. Since dx{k) can be incremented by at most 
q*^^^ in a frame and dx{kn) = 0, fc„ - fc„ > nbjq*^^^ and 
fcn-i-i - kn > kn - kn > nS / q*,^^^. Thus, 

Prob{In = 1} < Prob{kn+i - fc„ > n6/q^^^} 
= Prob{k2 - fci > nS/q:^^J, 

and 

00 00 

Y, Proh{In - 1} < E ^™Hfc2 - /ci > nS/ql,,,} 

n=l 71—1 

< E[k2 - ki] < (X), 

By Borel-Cantelli Lemma, the probability that /„ = 1 
for infinitely many n's is zero, and so is the proba- 
bility that dx{k)/k > 5 for infinitely many fc's. Thus, 
limsupj._^o2 (ix(fc)/fc < 5 with probability 1, for all 
X & S and any arbitrary J > 0. Finally, we have 
limfe^oo dx{k)/k — with probability 1 since dx{k) > 
by definition. ■ 

Based on the above lemmas, we determine a sufficient 
condition for a policy to be a p-approximation policy. The 
proof is based on the Foster-Lyapunov Theorem: 

Theorem 5 (Foster-Lyapunov Theorem): Consider a 

Markov chain with state space V. Let D{k) be the state 
of the Markov chain at the fc*'' step. If there exists a 
non-negative function L : V ^ R, a positive number 6, 
and a finite subset Vq of V such that: 



E[L{D{k + 1)) - L{D{k))\D{k)] < -S, if D{k) (j, 2?o, 



(6) 

E[L{D{k + l))\D{k)] < 00, if D{k) e Va, 

(7) 

then the Markov chain is positive recurrent. 

Theorem 6: A policy r/ is a p-approximation policy, for 
some p > 1, if it schedules jobs solely based on the 
requirements and the state of a system and, for each k, 
the following holds: 

J2^xik)dxik)>i max Yqxdxik))/p. 

xes wxj: [qx\ is feasible ^g^ 

Proof: Consider a system with minimum reward re- 
quirements [q^] such that the same system with minimum 
reward requirements [pqx] is also strictly feasible. By 
Lemma [3j it suffices to show that under the policy ry, 
the resulting Markov chain is positive recurrent. Consider 
the Lyapunov function L{k) :— J^xes'^xik)/'^- The Lya- 
punov drift function can be written as: 

ALik + 1) :=L(fc + 1) - L{k) = i ^ [4(fc + 1) - 4(fc)] 



xes 



sr> 



<2^{q*X-qxmdx{k) + C, 
xes 



where C is a bounded constant. Since [pqx] is 
also strictly feasible and dx{k) > 0, there ex- 
ists e > such that (1 + £)J2xesP'ix'^x{k) < 
"^^""[qx]: [qx] is ieasihleT. xes<lxdx{k), and hence (1 + 
'^)J2xes'i*xdx{k) < J2xes^x{k)dx{k). Thus, we have 

AL{k + l)<-eY,<l*xdxik)+C. (8) 

xes 

Let Vq be the set of states {dx{k)} with J2xes Ix^xik) < 
{C + 5)/e, for some positive finite number 5. Then, Vq is a 
finite set (since g^ > for all x e S), with AL{k+l) < -6 
when the state of frame k is not in Vq. Further, since 
dx{k) can be increased by at most q*^ in each frame, L{k+ 
1) is finite if the state of frame k is in Vq. By Theorem[5] 
this Markov chain is positive recurrent and policy -q fulfills 
this system. ■ 

Since a 1 -approximation policy is also a feasibility 
optimal one, a similar proof yields the following: 

Theorem 7: A policy r] fulfills a strictly feasible system 
if it maximizes J2xes qx{k)dx{k) among all feasible [qx] 
in every frame k. It is a feasibility optimal policy if the 
above holds for all strictly feasible systems. 

VI. An On-Line Scheduling Policy 

While Section |V| has described a sufficient condition 
for designing feasibility optimal policies, the overhead 
for computing such a feasibility optimal scheduling pol- 
icy may be too high to implement. In this section, we 
introduce a simple on-line policy. We also analyze the 
performance of this policy under different scenarios. 

Theorem [7] has shown that a policy that maximizes 
J2xes qx{k)dx{k) among all feasible [qx] in every frame 
k is feasibility optimal. The on-line policy follows this 
guideline by greedily selecting the job with the highest 
r^dxik) in each time slot. Assume that, at some time t 
in frame k, task X has already been scheduled ix times 
in its period. The on-line policy then schedules the task 
Y so that r\TdY{k) is maximized among all X e S. A 
more detailed description of this policy, which we call the 
Greedy Maximizer, is shown in Algorithm [21 

Next, we evaluate the performance of the Greedy Max- 
imizer. We show that this policy is feasibility optimal if 
the periods of all tasks are the same, and that it is 2- 
approximation in general. 

Theorem 8: The Greedy Maximizer fulfills all strictly 
feasible systems with tx = t, for all X & S. 

Proof: It suffices to prove that the Greedy Maximizer 
indeed maximizes J2xes ^x ik)qx (k) in every frame. Sup- 
pose at some frame k, the reward debts are {dx{k)} 
and the schedule generated by the Greedy Maximizer is 
VGM{t), t e (fcr,(fc + l)r]. Let GM -.= Y.xesdx{k)qx{k) 
when "qcM is applied. Consider another schedule, 
Voprit), that achieves MaxJ2xesdxik)qxik) =: OPT 
in this frame. We need to show that GM > OPT. 

We are going to modify rjoprit) slot by slot until it 
is the same as ijgm. Let yfopri^) ^e the schedule after 
we have made sure ViQprp{t) — ijcAiit) for all t between 
kT and i, and let OPT^ := i2xesdx{k)qx{k) when 



Algorithm 2 Greedy Maximizer 



Require: S, {tx\X g 5"}, {rx[X G 5, 1 < i < tx}, 
{q*x\X(.S) 
1: T <— least common multiplier of {tx\X e S} 
2: for X e S' do 
3: dx 4- 
4: end for 

5: fc .^0 
6: f ^ 
7: loop 

if t mod T = 1{A new frame} then 
k ^ k + 1 
iov X (^S do 



9 

10: 

11 

12: 
13: 
14: 
15: 
16: 
17: 
18: 
19: 
20: 
21 
22: 
23: 
24: 
25: 



dx <- [dx + q*x- qx]'^ 
qx ^0 
end for 
end if 
for X eS do 

if t mod Tx — 1{A new period for X} then 

ix ^0 
end if 
end for 
Y 

iy ■<— lY 



argmaxxes?'^'''^^ 
1 



X 



qy 



qy + rp- 



execute the job of Y at time t 
end loop 



Vopri't) i^ applied. We then have rjopT = Vc^pt ^^i^ 
r]cM = 77^'^+^)^. The process of modification is as follows: 
If riQprp{i + I) = f]GM{i + 1), then we do not need 
to modify anj^hing and we simply set rj^Qpj. = rj^pj.. 
On the other hand, if tfopTi"^ + 1) t^ VcAiii + 1), say 
rjGAiii + 1) = {AJa) and rj})prp{i + 1) = {B,jb), then 
we modify ifopxi^) tmder two different cases. The first 
case is that rJQpj, is going to schedule the action (A, j^) 
some time after i + 1 in this frame. In this case r/Q^^ is 
obtained by switching the two actions {A,ja) and {B,jb) 
in rjQprp. One such example is shown in Fig. [Saj Since 
interchanging the order of actions does not influence the 
value of 'Exesdxik)qx{k), we have OPT'+^ = OPT' 
for this case. The second case is that "^Qp^p does not 
schedule the action {A,ja) in the frame. Then rj^Qpj. is 
obtained by setting i]^Qpp{i + 1) = i^,JA) and scheduling 
the same jobs as jyopy for all succeeding time slots. Since 
the Greedy Maximizer schedules {A,ja) in this slot, we 
have r'^dAik) > r'gdB{k). Also, for all succeeding time 
slots, if job B is scheduled, then the reward for that slot 
is going to be increased since the number of executions 
of job B has been decreased by 1; if a job C other than 
A and B is scheduled, then the reward for that slot is not 
influenced by the modification. Fig. [3b] has illustrated one 
such example. In sum, we have that OPT^^^ > OPT^. 

We have established that OPT'+^ > OPT' for all 
i e [kT,{k + 1)T]. Since OPT = OPT^^ and GM = 



,„l • • • 

'I OPT 



„i+l • • • 

7 OPT 



(BJb) (AJa) (C,jc) (DJd) I 
• • • • • 

(AJa) (BJb) (C,jc) (DJd)! 
• • • • • 



(a) First case 



(BJb) (BJb+1) (CJc) (D, b) I 
• • • • • 

(AJa) (BJb) (CJo) (D,b)| 
• • • • 1 

(b) Second case 
Fig. 3: Examples of modification in Theorem [8] 



„i • • • 

'l OPT 



,J+I • • • 

7 OPT 



A.B 



B 



A.B 



I (A. 1) ^ (A, 2) ^ (A, 3) ^(A,4) ^ (B,1) ^ (A,5) j ^ 

(a) Greedy Maximizer 

AB b A,B 

I (A, 1) (A, 2) (B, 1) I (A, 3) (A, 4) (B, 1) I thus 0P¥+^ > OPT^ - r^/d^(fc). 

• • • • • • f In sum, for all i, if the Greed\ 



same way as in the proof of Theorem [8] By Theorem [6l 
it suffices to show that GM > OPT/2. 

We obtain ?/qp7- as follows: If yycAf (* + l) = Vopri^^^)' 
then we set rj}+prj, = ijopj,. If 7?gm(« + 1) = (AJa) ^ 
{B,jb) = Vopri^)' then we consider three possible 
cases. The first case is that the job {A,ja) is not sched- 
uled by rjQprj, in this period of A. In this case, we set 
'?OPr(* + 1) — (A, 3 a) and use the same schedule as 
VoPT ^°^ ^11 succeeding time slots. An example is shown 
in Fig. [5al The same analysis in Theorem [8] shows that 
OPT'+^ > OPT\ The second case is that the job {A,ja) 
is scheduled by viQprp in this period of A and there 
is no deadline of B before the deadline of A. In this 
case, we obtain rfQpq- by switching the jobs {A,ja) and 
{B,jb) in rJQpx- An example is shown in Fig. [Sbj We 
have OPT"^ = OPT'-+'^ for this case. The last case is that 
the job {A,ja) is scheduled by viopj^ in this period of A, 
and there is a deadline of B before the deadline of A. 
In this case also, we obtain rfQpj' by switching the two 
jobs and renumbering these jobs if necessary. The rewards 
obtained by all tasks other than B are not influenced by 
this modification. However, as the example shown in Fig. 
3 the job {B,jb) in 7?opt tnay become a job {B,j'g) in 
rj^QPj. with j'q > JB ■ Thus, the reward obtained by B may 
be decreased. However, since rewards are non-negative, 
the amount of loss for B is at most r^ . By the design 
of Greedy Maximizer, we have r'^dAik) > t'j^ dB{k) and 



(b) Feasibility optimal scheduler 

Fig. 4: An example of the resulting schedule by the Greedy 
Maximizer and a feasibility optimal scheduler, respectively 
in Example [TJ 



OPT(fc+i)T^ we have GM > OPT and thus the Greedy 
Maximizer indeed maximizes X]xgs'^-^(^)^-^(^)- 

■ 

However, when the periods of tasks are not the 
same, the Greedy Maximizer does not always maximize 
^XGs'^x{k)qx{k) and thus may not be feasibility opti- 
mal. An example is given below. 

Example 1: Consider a system with two tasks, A and 
B, with ta = Q, tb =3. Assume that r\ = r\ = r\ ^ 

2 _ 3 _ n 
B — ^ B — '^■ 



In sum, for all i, if the Greedy Maximizer schedules 
(AJa) at time slot i + 1, we have OPT'+^ > OPT' - 
r^^dAik). Thus, GM ^ C'pr(fe+i)r > OPT'''^ - GM = 
OPT - GM and GM > OPT/2. ■ 

VII. Simulation Results 

In this section, we present our simulation results. We 
first consider a system with six tasks, each with different 
period, tx, length of mandatory part, mx, and optional 
part. Ox. Let fx{t) be the total reward X obtained in a 
period if it executes t time slots of its optional part in the 
period. Thus, per our model, we have 



' X 



fx {i - mx 



H, 

■1) 



if i < mx, 



< mx + Ox, 



100, r\ = r\ = 1, r)j = 10, and r| 



Suppose, at some frame k, dA{k) — dB{k) = 1. The 
Greedy Maximizer would schedule jobs as in Fig. [4al and 
yield dA{k)qA{k) + dB{k)qB{k) = 411. On the other hand, 
a feasibility optimal scheduler would schedule jobs as in 
Fig.[4bl and yield d^(fc)g^(fc) + dB(fc)te(A:) = 420. ■ 

Although the Greedy Maximizer is not feasibility opti- 
mal, we can still derive an approximation bound for this 
policy. 

Theorem 9: The Greedy Maximizer is a 2- 
approximation policy. 

Proof: The proof is similar to that of Theorem [8j 
Define 7]gm,vopt,Vopt^GM,0PT, and OPT' in the 



X\i - mx -I- -Lj 

- fx{i-mx), iimx <i <mj 
0, if i > rax + ox 

As in [?], we consider three different t5^es of function 
fx'- exponential, logarithmic, and linear. The reward re- 
quirement of X is mxH + q*^. We compare the set of 
requirements of tasks that can be fulfilled by the Greedy 
Maximizer against the set of all feasible requirements. 
We also compare the optimal policy (OPT) introduced in 
[?], which aims to maximize the total per period reward, 
^x^s'i^l 7~- '^° better illustrate the results, we assume 
that all qX^'s are linear functions of two variables, a and 
j3. We then find all pairs of {a, /3) so that the resulting 
requirements are fulfilled by the evaluated policies and 
plot the boundaries of all such pairs. We call all pairs of 
(a, p) that are fulfilled by a policy as the achievable region 



'/ OPT 



n' • • • 

'/ OPT 



,J+1 • • • 

7 OPT 



(BJb) (B,JB+1) (C,Jc)i(A, 1) . . . 

• • • • • 

(A.U) (BJb) (C.Jc)i(A,1) • • • 

• • • I • 



(a) First case 



y,i+I • • • 

7 OPT 



(BJb) (BJb+1)(C,Jc) (AJa)!' 

• • • • • 

(A.k) (BJb) (C.jc) (BJb+1)I ' 

• • • • • 

(b) Second case 

B A 

^ (B,Jb)|(B,1) ^(B,2) ^(A,u)| ' 

B ▼ A 

(A,U) I (B,1) (B,2) (B,3) | ' 



(c) Third case 
Fig. 5: Examples of modification in Theorem [9] 



of the pohcy. We also call the set of all feasible pairs of 
(a, /3) as the feasible region. The complete simulation pa- 
rameters are shown in Table [H in which most parameters 
are derived from the simulation set up of [?]. 

In each simulation of the Greedy Maximizer, we initiate 
the debt of X to be i/ + 1 and run the simulation for 20 
frames to ensure that it has converged. We then continue 
to run the simulation for 500 additional frames. The 
system is considered fulfilled by the Greedy Maximizer 
if none of the mandatory parts miss their deadlines in the 
500 frames, and the total reward obtained by each task 
exceeds its requirements. 

The simulation results are shown in Fig. [6l For 
both cases of exponential and logarithmic functions, the 
achievable regions of the OPT policy are rectangles. That 
is because the OPT policy only aims at maximizing the to- 
tal per-period rewards and does not allow any tradeoff be- 
tween rewards of different tasks. The achievable regions 
of the OPT policy are also much smaller than the feasible 
regions. On the other hand, the achievable regions of the 
Greedy Maximizer are very close to the feasible region for 
both the cases of exponential and logarithmic functions. 
Also, its achievable regions are strictly larger than that of 
the OPT policy. This also shows that the Greedy Maximizer 
can provide fine-grained tradeoff between tasks. 

The most surprising result is that for linear functions. 
In this case, the OPT policy fails to fulfill any pairs of 
(a,/3) except (0,0). A closer examination on the simula- 
tion result shows that, besides mandatory parts, the OPT 



Task id 


fW) 


fxit) 


f'iit) 


g*x 


A 


15(l-e-*/i5) 


71n(3t + l) 


bt 


5a 


B 


20(1 - e-3«/8) 


101n(10i + l) 


It 


7a 


C 


4(l_e-t/5) 


21n(3t + l) 


t 


a 


D 


10(1 - e-*/30) 


51n(15t-(-l) 


it 


4/3 


E 


5(l-e-«/5) 


31n(20t + l) 


2t 


2/3 


F 


8(1 _ e-*/20) 


41n(6t + l) 


3t 


3/3 



TABLE II: Task parameters for a system in which all tasks 
have the same period. 



policy only schedules optional parts of tasks D and F. This 
example shows that, in addition to restricted achievable 
regions, the OPT policy can also be extremely unfair. Thus, 
the OPT policy is not desirable when fairness is concerned. 
On the other hand, the achievable region of the Greedy 
Maximizer is almost the same as the feasible region. 
These simulation results also suggest that although we 
have only proved that the Greedy Maximizer is a 2- 
approximation policy, this approximation bound is indeed 
very pessimistic. In most cases, the performance of the 
Greedy Maximizer is not too far from that of a feasibility 
optimal policy. 

Next, we simulate a system in which all tasks have the 
same period. We assume that tx — 120, vtix = 0, and 
Ox = 120 for all X e S*. We also simulate all the three 
functions, exponential, logarithmic, and linear. Detailed 
parameters are shown in Table [III 

The simulation results are shown in Fig. [71 As in the 
previous simulations, the achievable regions of the Greedy 
Maximizer are always larger than those of the OPT policy, 
for all functions. Further, the achievable regions of the 
Greedy Maximizer are exactly the same as the feasible 
regions. This demonstrates that the Greedy Maximizer 
fulfills every strictly feasible system when the periods of 
all tasks are the same. 

VIII. Concluding Remarks 

We have studied a model in which a system consists of 
several periodic real-time tasks that have their individual 
reward requirements. This model is compatible with both 
the imprecise computation models and IRIS models. By 
making each task specify its own reward requirement, 
our model can offer better fairness, and it allows trade- 
off between tasks. Under this model, we have proved 
a necessary and sufficient condition for feasibility, and 
designed a linear time algorithm for verifying feasibility. 
We have also studied the problem of designing on-line 
scheduling policies and obtained a sufficient condition 
for a policy to be feasibility optimal, or to achieve an 
approximation bound. We have then proposed a simple 
on-line scheduling policy. We have analyzed the perfor- 
mance of the on-line scheduling policy and proved that 
it fulfills all feasible systems in which the periods of all 
tasks are the same. For general systems where periods 
may be different for different tasks, we have proved that 
the on-line policy is a 2-approximation policy. We have 
also conducted simulations and compared our on-line 



10 



Task id 


rx 


mx 


ox 


fxit) 


/^^W 


nit) 


rx 
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20 


1 
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15(l-e-*/2) 


71n(20t + l) 
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5a 


B 


30 
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20(l-e-3*/2) 
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7a 


C 


40 


2 


20 


4(l_e-t/2) 


21n(10t + l) 


t 


a 


D 


60 


3 


30 


10(l-e-*/iO) 


51n(25i + l) 


At 


4/3 


E 


80 


4 


40 


5(l-e-*/2) 


31n(30t + l) 


2t 


2/3 


F 
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6 


60 


8(1 - e-'/2") 


41n(6t + l) 


3t 


3/3 



TABLE I: Task parameters for a system in which tasks have different periods, fj^, f^, and /|- correspond to the 
functions for exponential, logarithmic, and linear functions, respectively. 
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(a) Exponential functions (b) Logarithmic functions (c) Linear functions 

Fig. 6: Achievable regions of scheduling policies for the system in Table [H 
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Fig. 7: Achievable regions of scheduling policies for the system in Table UIl 



policy against a policy that maximizes the total reward 
in the system. Simulation results show that the on-line 
policy has much larger achievable regions than that of 
the compared policy. 
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